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Abstract 

Properties of Random Overlap Structures (ROSt)'s constructed from the Edwards- 
Anderson (EA) Spin Glass model on Z*^ with periodic boundary conditions are studied. 
ROSt's are N x N random matrices whose entries are the overlaps of spin configurations 
sampled from the Gibbs measure. Since the ROSt construction is the same for mean- 
field models (like the Sherrington-Kirkpatrick model) as for short-range ones (like the 
EA model), the setup is a good common ground to study the effect of dimensionality 
on the properties of the Gibbs measure. In this spirit, it is shown, using translation 
invariance, that the ROSt of the EA model possesses a local stability that is stronger 
than stochastic stability, a property known to hold at almost all temperatures in many 
spin glass models with Gaussian couplings. This fact is used to prove stochastic stability 
for the EA spin glass at all temperatures and for a wide range of coupling distributions. 
On the way, a theorem of Newman and Stein about the pure state decomposition of 
the EA model is recovered and extended. 

1 Introduction 

In this paper, we study short-range spin glasses from the point of view of Random Overlap 
Structures. We focus on the Edwards-Anderson model, whose definition we now state. For 
any finite A C Z"', the set of edges such that both endpoints are in A will be denoted by A*. 
The Hamiltonian of the EA model is defined on spin configurations cr G {—1, +1}'^ as 

H\^J = — ^ JxyO'xO'y , (1.1) 

{x,y} 
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where the summation is over all nearest-neighbor edges {x, y} in A* as well as additional 
edges at the boundary that endow A with periodic boundary conditions. (The choice of 
boundary conditions will not be important until Section O) The set J = (Jxy) for all edges 
{x, y} of are the couplings of the system. The definition of the EA model demands that 
each coupling J^y be distributed independently under a measure on M that is symmetric. 
The joint distribution of the couplings will be denoted by v{dJ). The Gibbs measure for the 
volume A at couplings J is defined as 

exp -(3HA,jicr) , . 

<^A,i3,A^) = y — 7^^^ (1-2) 

for Za,j(/3) = E<xe{-i,+i}A expl3HAj{a). 

A fundamental question is of the nature of infinite- volume Gibbs measures, i.e., limits 
as A — 7- of measures (11.21) . It is known that for high temperatures they have a simple 
structure (in fact there is only one, see, e.g., [lOj), while at low temperatures it could be 
that there are many "competing" states. A metastate, a measure on infinite-volume Gibbs 
states, is an object used to study these states and will be a main focus of the present paper. 
We note that the treatment of the metastate construction in Section 12.11 using de Finetti's 
theorem is non-standard and may be of independent interest. Because it is a measure on 
states, the metastate contains information on the correlation functions, local functions of 
spins, etc. An alternative viewpoint is to consider only the overlaps of the system (here we 
will look at edge overlaps, but spin overlaps can be considered as well). This is the idea 
of the Random Overlap Structure (ROSt). Basically, ROSt's are random matrices whose 
entries are the overlaps of independent replicas sampled from the Gibbs measure. Thus, 
ROSt's record by default all information on the diversity and structure of overlaps that is 
relevant for the thermodynamics. 

In this paper we construct a ROSt from the EA model's metastate. This consists of taking 
the thermodynamic limit of the system before measuring the overlap in an arbitrarily large 
window. (Similar measures were considered previously by Newman & Stein and Guerra |12j.) 
We show here that the metastate and the ROSt are very closely related. As an example, we 
present results about stability properties of the EA ROSt. We see that from well-studied 
translation-invariance properties of the EA model, it follows that its metastate obeys a local 
stability property. This in turn implies stochastic stability of the EA ROSt. Stochastic 
stability is known to hold for a large class of models with Gaussian couplings at almost all 
f3 [H [191 1211 in E]. The proof presented here holds for the EA model at all dimensions, all 
(3, and, somewhat unexpectedly, for a wide range of coupling distributions (including, e.g., 
ones that are continuous with support on the real line). This is a main observation of the 
paper. For completeness, an adaptation to the metastate setting of the standard approach 
to stochastic stability is given in the appendix. 

In Section we discuss the decomposition of Gibbs states in the support of the metastate 
into pure states and the relation between this decomposition and the representation of the 
ROSt on a Hilbert space. In particular, we use results of [4J on the support of a stochastically 
stable ROSt's sampling measure to deduce a recent theorem of Newman and Stein. It 



2 



says that no Gibbs state in the support of the metastate can have a (non-trivial) finite 
decomposition into pure states. In other words, each state must be either a combination of 
two fiip-related pure states or infinitely many. 

In Section [5|, we draw comparisons between short-range and mean-field models from the 
ROSt perspective. For example, although the EA model satisfies a local stability condition, 
the SK model does not due to the scaling of the couplings in the definition of its Hamiltonian. 
In addition, it is unclear in the EA model if two constructions of overlaps are equivalent: one 
where overlaps are constructed from a metastate in which the thermodynamic limit is taken 
before taking the limit of the overlap, and one where overlaps are "global" in the sense that 
both limits are taken simultaneously. Similar issues are raised in |TT]. It is shown here that 
in the case of the SK model, permutation invariance of the spins associated to correlation 
functions leads to equivalence of the two types of constructions. 

Acknowledgments. We thank Chuck Newman and Dan Stein for useful discussions and 
guidance. L.-P. Arguin gratefully acknowledges the support and hospitality of the Hausdorff 
Institute for Mathematics in Bonn during the Trimester Program in Stochastics, where part 
of this work was completed. 

2 Definitions 

2.1 Metastates 

The existence of a metastate measure on limits of Gibbs measure as treated here corresponds 
to the Aizenman- Wehr construction [2] . However, it is presented in a different way from the 
standard approach, invoking in particular de Finetti's Theorem. The advantage is twofold: it 
automatically includes a result of Newman and Stein on sampled replicas using the metastate 
(Proposition 7.1 of [I3]), and it is convenient for the construction of ROSt's. 

Let W he a. finite subset of Z"^. Let Gx,i3,j be the Gibbs measure ( II. 2p of the EA model 
where it is assumed that A D W . We consider the pair 

{J^ Ww}im) , (2-1) 

where {cx^jjeN is an infinite sequence of configurations ay/ G {— 1,+1}^ sampled from 
G\^l3^j and J = (Jxy) are the couplings for all the edges {x,y} of Z"^. The set of elements 
(12. ip is therefore endowed with the measure 

It is easily seen that the family of measures {M^)^(zzd is tight for a given W (the space 
{ — 1,+1}^ is compact). In particular, for any sequence A„ converging to Z'' there exists 

a subsequence {M^^'')^ that converges. In fact, by a diagonalization argument, this sub- 
sequence of A's can be chosen such that {M^^'')k converges for any finite W. We denote 
this family of limits by (M^v). This family is consistent in the sense that if C W, Mw' 
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restricted to configurations in W is M\y. By Kolmogorov's extension theorem, we obtain a 
measure M on 

(J, {(T*}ieN), where G {-1, +1}^' for all i. (2.2) 

We take the topology on { — 1, +1}^'' to be the product topology. 

A notion of Gibbs measure in the infinite-volume limit is recovered as follows. For every 
A, the conditional law of {o"|y}jgN given J under is exchangeable by the sampling 
construction, i.e., the distribution is invariant under permutations of finitely many indices 
ii, . . . , im- This symmetry is preserved in the limit A — )■ Z'^ and it follows that the conditional 
law of {(T*}jgN given J under the measure M is also exchangeable. The theorem of de Finetti 
on exchangeable sequences of random variables taking values in a Polish space (see, e.g., 
[3]) guarantees the existence of a probability measure kj on the space A^({ — 1,+!}^'') of 
probability measures on {-1,+1}^ such that 

M = u{dJ)[ Kj{dT)Y[T . (2.3) 

The measure nj is called a metastate of the sequence of Gibbs measures (^a,/3,j)a- It must 
be stressed that kj might not be defined for all J, but by conditioning, it must exist for 
zz-almost all J. It is customary to drop the dependence on /3 in the notation kj. It can be 
proved that the metastate is supported on F's that are infinite- volume Gibbs measures in 
the sense of the DLR equations [10] . Roughly speaking, one can see a metastate as the law 
of the empirical measure of a sequence of spin configurations sampled from a Gibbs measure. 
The above considerations can be regrouped in a theorem, which encompasses Theorem 4.2 
and Proposition 7.1 of [T3] . 

Theorem 2.1. Let (A„) be a sequence of finite subsets converging to if-. Let G^^^^^^j be 
the Gibbs measure in A with couplings J. Let v denote the i.i.d. Gaussian distribution on 
J = (Jxy)- There exists a subsequence (A„^) such that 

U{dj) X n^A„„,3,J ^ X / Kj{dV)r\V , 



eN 



where kj(c?F) is a probability measure on A^({ — 1, +1}^'*), the space of probability measures 
on {-1,+lf' . 

The convergence in the theorem is understood in terms of finite-dimensional distributions 
on the couplings and on the space { — 1, +1}^ . A metastate for the EA model enjoys a useful 
covariance property in J p]. Let J be a fixed set of couplings for which kj is well-defined. 
Let J' be another set of couplings such that kji exists and such that it equals J except 
on a finite set of edges contained in 1^ C Z*^. Write A J = (J^^ — Jx,y){x,y}£W*- Then the 
convergence of Theorem 12.11 together with (11.21) gives for any measurable function F of the 
sequence {o"*}igN 

f Kj,{dT) I F{{a^})\{dV = I Kj{dV) I F{{a'})\{df, , (2.4) 
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where for each i, 

r?; ( • ) 



and Hiv,Aji'^) = Y^{x,y}eW-' ^Jxy(^x(7y 

2.2 Random Overlap Structures 

The thermodynamic behavior of the EA model as /3 is varied is intimately linked with the 
structure of the metastate. For this reason, it is useful to investigate this structure (e.g., on 
how many F's is kj supported, decomposition of F's into extremal Gibbs measure, etc.) to 
determine properties of the EA model. Here we take this approach by looking more closely 
at the restrictions on the ROSt constructed from the metastate. 

Definition 2.2. A Random Overlap Structure (ROSt) is a random Nx N-covariance matrix 
with 1 's on the diagonal whose law is partially (weakly) exchangeable. In other words, if 
Q = {%■} ^ ROSt, then for any permutation matrix it of a finite number of elements, 

■K~^Q-K = Q . 

We shall write P for the law of a ROSt and E for the expectation. Precisely, P is 
defined to be a Borel probability measure on the compact Polish space of positive semi- 
definite symmetric N x N matrices with I's on the diagonal (considered as a closed subset of 
[— 1, equipped with the product topology). The interest in ROSt lies in the following 

characterization result. 

Theorem 2.3 (Dovbysh-Sudakov [5J). Let Q be a ROSt. There exists a random proba- 
bility measure /i on the unit ball B of a Hilbert space Ti with inner product "■ " such that, 
conditionally on fi, 

Uij ■ ^T^j} {v' -v^ : i^ j} 
where (f*)igN o'^e i.i.d. ^-distributed and denotes equality in law. 

The role of /i is analogous to that of the empirical measure in the standard de Finetti's 
theorem for exchangeable sequences of random variables. We say that /i is the sampling 
measure of the ROSt. The samphng measure n is not unique, however, if two sampling 
measures yield the same ROSt, they differ by an isometry of % that depends possibly on the 
reahzation of [TB] . 

The law of a ROSt is determined by the finite-dimensional distributions of the entries of 
the matrix. Equivalently, it is determined by the expectation over the continuous functions 
on s replicas for every s G N. A function F : i?'^ — )■ M mapping v = [v^, ...,v^) to M is said 
to be a continuous function on s replicas if it is a continous function that depends on the 
product between distinct replicas, that is, of the form 

F{v) = F{v' -v^ : l<i<j<s). (2.5) 
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In view of Theorem 12.31 the expectation of F over a ROSt Q = {qij} then reads 

E[F{q,, : 1 < t < j < s)] = Eli^^'^Fiv' ■ : I < t < j < s))], 

where the product of s copies of /i is denoted by /x^*. 

For spin glasses, ROSt's are useful because they encode all information on the overlaps 
of the system. By overlap, we mean a non-negative definite symmetric form on { — 1, +1}^. 
Several choices are possible. In this paper, we focus on edge overlaps, though a treatment 
for other overlaps like spin overlaps is similar. We shall be interested in the edge overlap in 
the finite set W^: ^ 

R^i(T, a') = TTTT-T ^ (T^(Ty(T'^(Ty , (2.6) 



W* 



{x,y}&W* 

where the summation is over all edges whose vertices are both contained in W, and for 
a, a' G {—1, +1}^ , the edge overlap 



R{a, a') 



1 



lim , 

W^Zd \ W* 



E 



(2.7) 



{x,y}&W* 



whenever the limit is well-defined. The first is a local variable and the second is a limit of 
local variables. 

We first construct a ROSt from a metastate kj of the EA model and the overlap as 
follows. Consider the elements ({cr*}jgr^) equipped with the probability measure 



[ Kj{dT)T\T. 



We define the law of a random covariance matrix = {q^{J)} by 



E 



F{q^{J) : l<i<j<s) 



Kj{dT)T'''{F{R^{a\a^) : I < i < j < s] 



{21 



where F is any continous function F on s replicas. In other words, the entries of 
correspond to i?^-overlaps of replicas sampled from F which in turn is sampled from the 
metastate kj. It is also possible to define the averaged ROSt from the above equations 
by integrating over v{dJ). By construction, the law of is weakly exchangeable. In 
particular, by Theorem 12. 3[ there exists a (random) sampling measure on "H such that 



E 



F(gS^(J) : l<i<J<s) 



= E 



(2.9) 



A ROSt for the limit R of the overlap R^ can also be constructed from the metastate. 
However, in this case, we need to appeal to translation invariance to ensure the existence of 
the limit (12. 7p . This is done in the next section. We remark that an alternative construction 
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of an infinite-volume ROSt would be to take W growing with the size of the system A, for 
example by defining = {qfj} (as in 



E 



: 1 < ^ < J < s)] = J v{dJ) GXp^j{da)[F{R\a\a=) : 1 < z < j < s)) , (2.10) 



and investigate the limit points of Q^. This is a procedure that could possibly lead to 
limits that differ from those previously constructed by taking the metastate limit A — )■ Z,'^ 
followed by an overlap limit W ^ 7/. We favor here the second one, since it appears to us 
physically more natural. As shown in Section |5l the two procedures yield the same ROSt in 
the mean- field case. 



3 Preliminary results 

From this point on, it will be assumed, unless otherwise stated, that the boundary conditions 
of the finite system in a box A are periodic in all directions. This will imply translation 
invariance of infinite-volume quantities, and as a byproduct, stability of the ROSt under 
deterministic as well as stochastic perturbations. 

Let T = {To} be the translations by any vector a in 7/. The operators Ta act on the 
space of couplings and the sequence of replicas by 



Ta{J-, — Ta{{Jxy}, {Wx}x}im) — {{Jx+a,y+a}, {Wx+a}x}: 



Because of the periodic boundary conditions, the measure M on (J, constructed 
prior to equation 02.21) is readily seen to be invariant under translation (in other words 
T = {Tg} is a collection of measure-preserving maps for M). In particular, it implies that 
the the measure v{dJ) x kj on the pair (J, F) is translation- invariant. (Here Ta(F) is defined 
by Ta{V){A) = T{TaiA)) for events A, where Ta{A) = {T^^ct : a e A}.) This is because F, 
being the empirical measure of {o"*}jgN, is a measurable function of (J, {cr'jjgi^). 

Translation invariance of the measure M has two main consequences by means of Birkhoff's 
ergodic theorem. First, it provides a way to prove the existence of limits. Typically, this 
is used to prove the existence of the overlap between two configurations sampled from a 
given measure. Second, any J-measurable function that is also translation-invariant will be 
a constant //-almost everywhere. This is simply because the measure u is ergodic, being a 
product measure on J's. 

Consequences of translation invariance have already been investigated by Newman and 
Stein in [11]. Their result is extended here to the setting of ROSt, which will be needed to 
prove stability of the overlap distributions in the next section. For this purpose, we consider 
the edge overlap defined for a and a' in { — 1, +1}^ by 



i?(a,aO:= Jim^-^ E • (3-1) 



{x,y}&W* 
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It is a direct consequence of the ergodic theorem that this hmit exists almost surely under 
the measure M . Therefore the definition of the ROSt for the limit overlap R can be done 
the same way as in ( I2.8p . We denote the ROSt Qj = {qij{J)} in this case Qj, and Q for the 
averaged one. The definition of Qj is 



E 



{F{qi,{J) : l<z<J<s))]= j Kj{dT)T'''{F{R{a\a^) : 1 < ^ < J < s)) , (3.2) 



and in terms of its sampling measure of Theorem 12.31 (denoted /ij), 



E 



^iY{F{v'-v^ : l<i<3<s)) = J Kj{dT)T''' (^F{R{a\a^) : I < i < j < s)^ . (3.3) 

Since the overlap R is the pointwise limit of the overlap R^ , the following is straightforward 
from the dominated convergence theorem. 

Theorem 3.1. For v-almost all J , QY — ?■ Qj in law . 

The main observation of [llj is that translation invariance implies that the distribution 
of the overlap of two replicas does not depend on the realization of the couplings J, i.e., for 
any measurable set A of M and for //-almost all J, 

j Kj{dT) r X T^R{(y\a'^) e = J v{dJ) j kj{T) T x T^R{a\a'^) E a| . (3.4) 

One way to see this is as follows. R is clearly a T-invariant function 

RiTaa,Taa') = Ria,a'). 

Moreover, T x r|_R(cr^, a^) E A^ is a measurable function of (J, {cr*}jgN) since by exchange- 
ability 

Jim - ^ l|i?(a2"-\ a^') E A^ = T x r|i?(a\ a") E . 



Hence (J, {cr^jig^) i— t- F x T^^R{a^,a^) E a| is a T-invariant function and its integral over 

Kj only depends on J. Equation fl3.4p follows by ergodicity of the measure u. 

Our first result is a straightforward generalization of the above reasoning to the distri- 
bution for an arbitrary number of replicas, in other words, to the ROSt of the EA model. 

Theorem 3.2. Let Qj be the ROSt constructed in (13. 2p from the metastate kj and the 
overlap (12. 7p . Denote by Q the corresponding averaged ROSt. Then 

Qj = Q for v-almost all J . 

Proof. The proof is direct from the triviality of the tail field of the couplings J under z/, and 
the fact that, for any s and any continuous function F on s replicas the function 

J Kj{dT)T'''(^F{R{a\a^) : I < i < J < s)^ 

is a T-invariant function, since R is. □ 
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4 Main Results 



4.1 Stability of the EA model 



We first give a simple proof of stability of the ROSt defined from the metastate of the EA 
model and the edge overlap R under a deterministic change of a finite number of couplings. 
We call this property of the ROSt local stability. Afterward we will state a main result, 
that local stability in fact implies stochastic stability of the ROSt, a well-studied property 
of the Gibbs measure of spin glasses (see e.g. [H UHl EH HJ |6] and [8] where a variation in 
which couplings are flipped is studied). Throughout the section, it will assumed that the 
distribution z/ on the couplings is continuous and its support is M. 



Theorem 4.1 (Local Stability). Let W G 'Z'^ be finite and consider a deterministic collection 
J' = {J'^y : {x,y} e W*). Define H{y{a) = T.{x,y}ew* J'xy (^x(^y For any continuous 
function F on the R-overlaps (13. ip of s replicas and for u-almost all J', 



rx«(e/^S-i^V(-')F(cr)) 



Kj [r-(F(^))] 



F{R{a\a^) : 1 <i < j < s). In other words we have 

law 



where F{<j) 

rt law ^, 
VJ — vj 

where Qj is the ROSt defined by (13. 2p and Q'j is defined similarly with T replaced by 

r(e/3-f^(^M) ■ 

Proof. Let F be a continuous function on the -R-overlap of s replicas. Recall that i? is a T- 
invariant function. Consider W, a finite subset of Z*^. We write J{W) for the set of couplings 
that equals Jx,y for any edge {x, y} with at most one endpoint in W and that equals Jxy + J'xy 
for any edge {x, y} with both endpoints in W . Since a metastate is well-defined for //-almost 
all J, Kj(vy) is well-defined for i/-almost all J' . By the property (12.41) of kj, we have 



Kj^w) [rx^(F(^))] 



T^'^{e^^U^"wi-')F{cT)) 



(4.1) 



On the other hand, it was proved in Theorem 13. 2l that the above expectation does not depend 
on J. Therefore 

^JiW) [rx^(F(^))] = [r-(F(^))] . (4.2) 
The claimed identity is obtained by combining (14. ip and (14. 2p . □ 

Local stability of the EA model involves a local and deterministic transformation of the 
metastate. For stochastic stability, the transformation is random and global. 
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Definition 4.2. A ROSt with sampling measure jj, is said to he stochastically stable if for 
any A > 0, s G N, the ROSt defined from the sampling measure 



Xl{v)-^\\vW^^ 



(4.3) 



has the same law as the original ROSt, where {l{v),v & B) is a (isonormal) Gaussian field 
on B independent of ii with Ei\l{v)l{v')] = v-v' , and Ei denotes the expectation over the field 
I. In other words, for any continuous function F on s replicas. 



/i e 



M{v)-^\ 



E 



A simple justification for tlie appearance of e 2 W^W in ( |4.3p is that the expectation 
^^gAi(i;) ^—{i-\\v II) _ turns out that this factor is necessary for the mapping sending 

to (14.31) to be well-behaved [1]. The contribution e~ is irrelevant due to the normalization, 

-Aiii ii2 

and so is the term e~~"''" in the case where /x is supported on a sphere. 

The assumptions of the next theorem on stochastic stability of the ROSt of the EA model 
are weaker than the previously known results on stochastic stability. For one, it holds for a 
large choice of coupling distributions, as opposed to Gaussian couplings only. Second, the 
proof holds at any value of the Gibbs parameter /3. General results of stochastic stability 
are usually based on the differentiability of the free energy in the parameter /3, see, e.g., 
[T71 H]. Thus they are usually shown to hold at almost all values of the parameter /3. (For 
the SK model, it is known from the validity of the Parisi formula that the free energy is 
different iable at all (3 [I5].) The approach based on the free energy applies to the setting of 
the ROSt defined from a metastate, however some modifications are necessary. This is done 
in Appendix |Al 

Theorem 4.3. For every /3 > and for any distribution v on the couplings that is continuous 
with M as support, the ROSt Qj defined in (13. 2p from a metastate kj of the EA model is 
stochastically stable. 

The proof of Theorem 14.31 will be given in Section [61 It can be extended to other coupling 
distributions, for instance continuous ones with bounded support. We restrict our attention 
to the case where the support is the real line for simplicity. 



4.2 Pure states and ROSt's 

For each fixed coupling realization J, denote by ^ = the set of all Gibbs measures with 
the EA Hamiltonian ( 11. ip (we will write Qj when we would like to emphasize dependence on 
J, although we suppress the appearance of /3 in the notation). The set Q is plainly convex. 



10 



It is not difficult to see that it is compact as well (in the weak topology). Because the space 
of spin configurations is a metric space, Choquet's theorem applies, and each F G ^ can be 
written as a convex combination of the extreme points of Q (the pure states, written ex{Q)). 
In fact, more is true: each T E Q has a unique decomposition into pure states. To make this 
statement precise, we take the Borel cx-algebra J-" on the space 

Ai = Borel measures on {—1, +1}^'* , 

generated by the sets S{f,B) = {T E Q : r(/) G B}, for / a continuous function on 
{-1, +1}^' and i3 a Borel subset of M. 

Theorem 4.4. For each J and T G Qj, there exists a unique measure m-p on (A^, J-") such 
that mr{ex{Qj)) = 1 and 

T = p mridp) . 
Jm 

Proof. This theorem is a consequence of the Choquet-Meyer decomposition (see, e.g.. The- 
orem 1.5.9 of [20]) and the fact that the set ex{Qj) is a simplex [201 Theorem III. 2. 4]. Note 
that the latter theorem is stated in [20] for translation-invariant Hamiltonians but the proof 
is valid for the EA Hamiltonian with arbitrary nearest-neighbor coupling configurations 

iJ.y). □ 

Theorem 14. 41 allows us, for a given coupling configuration J, to decompose Gibbs measures 
in the support of the metastate kj into pure states. Furthermore, since the overlap R = 
limiY^^d exists M- almost surely (recall the definition of M in (12. 3p ). we see that for 
p{dJ) X Kj((ir)-almost all F, the associated measure mr must be supported on pure states 
with this same property. Using the fact that pure states have trivial tail fields (see, e.g., 
[20| Theorem III. 2. 5]) and mixing properties of pure states, one may argue that for i'{dJ) x 
Kj((iF)-almost all F, if we sample two pure states pi and p2 independently from mp, then 
the variable i? is pi x p2-a.s. a constant. (A sketch of the proof of this fact will be given in 
Appendix [HI) We denote this value of the overlap pi ■ p2. 

In some cases, we may draw an explicit correspondence between pure states in the support 
of mr (for F in the support of kj) and vectors in the support of the sampling measure pj 
of the ROSt Qj. For this purpose, we will write Qj in a slightly different way. Define the 
matrix-valued map P on the space of (J, {cr*}j)'s by setting P((J, {o"*}i)) = Q, where 

{Q\,=R{a\a^) . 

This map is defined on a set of M-probability one. P is a Borel measurable transformation 
to the space of covariance matrices introduced in Section 12.21 Note that for //-almost all 
coupling configurations J, the push-forward of the regular conditional probability measure 
M(- I J) by the map P is exactly equal to the law of the ROSt Qj, defined in Section fI72[ 
For a given value of (J, F), we shall also condition on the value of F and denote by Pjj the 
push-forward of the conditional probability M(- | (J, F)) by the map P. Since the conditional 
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law of is i.i.d. given (J, F), it is clear that for v{dJ) x Kj((ir)-almost all (J, T), the 

measure Pjj is weakly exchangeable (i.e., it the law of a ROSt) and if we denote by /ijj its 
sampling measure, then for any continuous function F of s replicas, we have 

so that, if P is the law of Qj, then 

^[^lJ{F{v'■v^ : l<i<j<s))\= j f,j{dr)Ej^r[f^l^{F{v'-v^ : 1 < t < J < s))] . 

The following was proved in [1]. 

Theorem 4.5. Let P be the law of a stochastically stable ROSt and let /i be its sampling 
measure. Then 

P(/i is supported on a single vector or an infinite- dimensional subset of B) = 1 . 

By Theorem 14. 3t the EA ROSt is stochastically stable at all inverse temperatures p. 
Therefore, we may apply Theorem 14.51 It follows from the above construction that for 
ui^dJ) X Kj((ir)-almost all (J, T), the sampling measure /ij,r is Pj,r-a.s. supported on a 
single vector or an infinite-dimensional subset of B. 

For certain (J, r)'s we may construct the sampling measure explicitly. Suppose that 
(J, r) is such that there is an integer with 

N 

1=1 

for pure states (pi) and weights (wj) satisfying Xlili'^j — 1- Partition the set {pi : 1 < i < 
A^} into equivalence classes of congruent pure states, i.e., use the equivalence relation 

Pi ~ pj iff Pi- pk = Pj ■ pk for all I < k < N . 

Let nc be the number of equivalence classes, select a set of representatives pi, . . . , from 
the equivalence classes Ci, . . . , C„p and define the weights (wi) by 

Two pure states in different classes are called incongruent. Since the matrix A, defined by 

{A),j = p, ■ p, , (4.4) 

is positive semi-definite, it follows that we can find uc vectors vi, . . . ,Vnc in M"^ such that 
Vi ■ Vj = Pi ■ Pj for all 1 < i < j < n^. It is not difficult now to see that if we create a ROSt 
using the sampling measure 

nc 
i=l 
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on M"*^, then the law of this ROSt is the same as Pj,r- Since the samphng measure of a 
ROSt is unique up to Hilbert space isometry (see we thus arrive at the following result 
of Newman and Stein [13] : 

Corollary 4.6. With v{dJ) x Kj{dr)-probability one, the state T cannot be the sum of N 

mutually incongruent pure states for 1 < < cxd. 

Note that the result here is slightly stronger. One can repeat the construction above with 
small modifications to produce a sampling measure for each F that is a countably infinite 
sum of pure states. In that case, the argument rules out a matrix A (from (14. 4p ) that has 
finite rank. 



5 Relation to mean-field models 

Here we draw comparisons between the ROSt's of the EA model and the ones of the 
Sherrington-Kirkpatrick (SK) mean-field spin glass. The SK model is defined as follows. 
Fix an integer > and let {J^y '■ x y; x, ?/ G N} be a family of i.i.d. mean-zero Gaus- 
sian variables with distribution u. The SK Hamiltonian is defined for spin configurations 
ae{-l,+l}^by ^ 

Hn,J = ^ JxyC^xO'y (5.1) 

and the corresponding measure 



A^ 

l<x<y<N 



exp -f3HN,j{(r) , . 

''"•"i'^* = Z.Am • ' 



for Znj{/3) = X]cre{-i ^-^P ~I^Hn,j{ci)- The spin overlap will be denoted by 

N 



i?^(a,a') = ^X^a..a: 

x=l 



Since there is an edge between every two vertices, the edge overlap of the model is (up to a 
term of order 1/A^) simply half the square of the spin overlap. 

The construction of a metastate of Section [241 can be repeated verbatim for the SK model 
using the joint distribution of J = {J^y : x y; x,y E N} and spin configurations {cT]v}«eN 
sampled from (15.21) . (It can also be done for other mean-field models. The reader is referred 
to |9] for examples of the metastate framework applied to the Curie- Weiss model and the 
Hopfield model.) Let kj be a metastate constructed from the sequence {Gj^^p^j)]^. The 
measure 

M = v{dJ) X I Kj{dT)WT 

JMi\±iV*) 
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on elements (J, {o"*}) clearly has stronger symmetries than the EA equivalent, for which 
only translation-invariance held. Indeed, any permutation vr of finite elements of N acts on 
( J, {cr*}) as follows 

7r(^, {cr'}) = ({<^7r(x)7r(s,)}, • 

Since the laws of the Gibbs measures {Gn,/3,j)n are preserved under these transformations 
by the form of the Hamiltonian (I5.ip . the symmetry is inherited by the measure M. This 
symmetry was recently exploited in [IB] to obtain a representation of the free energy of the 
SK model. 

In the case of the SK model, the metastate is no longer supported on Gibbs measures 
in the sense of the DLR equations, as this notion is not defined for the graph with edge 
set {{x,y} : x ^ y; x,y E N}. For this reason, the notion of pure state is no longer 
well-defined. However, as it was discussed in Section 14.21 there is a connection between the 
pure state decomposition and the sampling measure of the ROSt for the EA model. As a 
result, we choose to study the sampling measure of the SK model as the analogue of a pure 
state decomposition. 

We define the ROSt Qj = {(lij{J)} constructed from the metastate kj as in (13. 2p for the 
EA model 



E 
where 



: l<^<J<s))] = j f^j{dr)r'''(^F{R{a\a') : 1 < ^ < J < s)) , (5.3) 



R{a,a') = lim 



The above limit can be shown to exist (F x F Kj((iF))-almost surely using de Finetti's theorem 
and invariance under permutations of the distribution of the spins. Moreover, as in the case 
of the EA model, the law of Qj equals the law of the //-averaged ROSt Q for //-almost all 
J. (This is a consequence of equation fl5.9p below.) It is also possible to define a limit ROSt 
by taking the limit of the overlap and of the Gibbs measure simultaneously as in (12.101) . Let 
= {qf^} be the ROSt defined by 



E 



(F(giJ : l<z<j< s))] = J u{dJ) G^^'^^^j(^F{R''{a\a^) : 1 < 2 < j < .)) . (5.4) 



In the following proposition, we show that the mean-field nature of the model guarantees 
that a subsequence of converges to Q defined by (15.31) . As pointed out below equation 
(I2.10p . this is not necessarily the case for the EA model. 

Proposition 5.1. Let {Nk) be a subsequence for which {GN,,.i3,j)k converges to the metastate 
Kj in the sense of Theorem \2.1\ Then the ROSVs {Q^'') defined by (15. 4p converge in law to 
Q defined by (15. 3p . 

Proof. Let F be a continuous function on s replicas of the form 

F{q., : l<2<J<s) = nC" ' 

i<j 
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for a collection of integers n^-. It is easily checked by, for example, the Stone- Weierstrass 
theorem that any continuous function on s replicas can be uniformly approximated by sums 
of functions of this form. We need to show that 



lim I u{dJ)G-^l^^j^F{R''^{a\an : 1 < ^ < J < s)) = 

lim j v{dJ) j Kj{dT)T'''(^F{R^{a\a^) : 1 < i < j < s] 



N 

The function F can be written as 

F{R^''{a\a^) : 1 < ^ < J < ^) = H 1^ E 



(5.5) 



cr* 0"-' . . . cr* 

Kj k XI,. ..,!:„ =1 



1,2 1,2 _, s-l,s s-l,s _, j<i -' 



where T = J2i<j ''^ij the iterated sums start with the pair (1,2) and include all pairs 
for i < j. We use the convention that the empty product equals 1 (in products above 
for which Uij = 0). We may use the invariance under permutation of spins of the measure 
/ u{dJ)GNf.^l3^j{da) to simplify this expression after integration over G]^* ^ j ui^dJ). We make 

a fixed choice (i.e., independent of k) of distinct vertices {x'f , . . . , x^^^ : i < j} by assigning 
x}'^, . . . , the set {1, . . . , ^1,2}, assigning , . . . , x]{^^ to the set {^1,2 + !,•••, ^1,2 + 

rii^s}, and so on, until we assign x^^^'^ , . . . .x'^'^]^-^ ^ to the set {T — ra^-i,.), . . . , T}. After 
straightforward combinatorics, (15. 6p becomes 

/ : 1 < ^ < J < ^)) = 

for some C > 0, that depends on F but not k. This holds because the dominant term 
in (15.61) after integration comes when all elements of {x\^ ^ . . . ,x'lf.^ : i < j} are distinct. 

The same development applies to F{R'^{a\a^) : I < i < j < s)j under the measure 

J Kj{dr)r^'^ v{dJ), since it is also permutation invariant, and one gets, for the same fixed 
set of distinct vertices {xW . . . , x^-'. : z < j}. 



j v{dJ) j Kj{dT)T'''(^F{R^{a\a^) : 1 < i < j < s)) = 

I u{dj) I .j{dr)rx^ (n<..<.. ) + 

i<j '-^ 



C (5- 



Equation (15. 5 p follows from the convergence to the metastate and by taking the limits /c — ?■ 00 
and iV — )■ 00 in (15.71) and (15.81) (note here that s, and therefore the rij/s, are fixed). □ 
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As discussed in Section H?T| the ROSt Q of the SK model is stochastically stable. However, 
we argue here that it cannot satisfy the property of local stability. This is simply because 
the factor 1/\/N appearing in f lS.ip will make any local change of the couplings vanish in 
the limit N ^ oo. Therefore no non-trivial identity similar to (12. 4p can be recovered. This 
can be made precise as follows. Let J' be a realization of the couplings that equals except 
on a finite set of edges between the first M spins. Plainly, for any fixed M and any e > 0, 
can be taken large enough so that 



-G 



N,I3,J\ 



< G 



N,I3,J+J' 



(■) 



G 



G,v,/3,j(e-/'^VW) 



— 1 13 j{ 

I — £ 



p 



where H'j^j = — X]i<z<?/<j\/ '^^^^y Since e is arbitrary, an argument identical to the one 
leading to (12. 4p yields for any measurable function F of {a*} the identity 



nj+AdV) I F{{a'})\{dV= ! Kj{dV) j F{{a'})\{dT . 



(5.9) 



It is interesting to note that, although no non-trivial transformation of the ROSt can be 
recovered from (15. 9p . the identity does imply that the metastate of the SK model is invariant 
under local changes of couplings (since it applies to any observable F on replicas). In the EA 
model, the identity holds for translation-invariant observables. It is for example not hard to 
see that it is not true for F({cr*}) = ci^o"^, with x and y nearest-neighbor sites, in the EA 
model. 



6 Proof of Theorem 14.3 



The identity of Theorem 14 . 1 1 remains true if a measure on the couplings J' is present, say u': 

"rx« (e^i^ "wi'^') F(o-)) 



/ 



U'{dj') Kj 



Kj [r-(F(^))] 



(6.1) 



for any parameter > as long as v' is absolutely continuous with respect to v. Take v' 
to be the product measure of standard Gaussian measures. The right-hand side is equal to 
E[/ij''(F(D))], by definition of the ROSt Qj and its sampling measure /ij in (13. 2p . In view of 



Definition 14. 2[ the proof reduces to establish, for an appropriate sequence (A^/ 
and for a given A > 0, the limit 



W C U") 



lim 



v'{dJ') K, J 



[e^wj:Uiiiw(<^') F{(t)) 



EjE 



/if (F(^;)e^'('"')-Vll-Ml^..e^'(-^)- 



^xs/'gA^(.l)- 



A2| 



A IL.s II 2 
2 II" I 



(6.2) 
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where / = {l{v),v G "H) is a Gaussian field independent of /ij, witli Eil{y)l{y') = v ■ v' , and 
El denotes tlie expectation over tliis field. 

A short argument motivates the limit fl6.2p . The identity (16.1 p is true for any Xy/ > 0. 
So for A G M, choose a sequence [Xw ■■ W C Z'^) such that Xw^J\W*\ ^ A as ^ Z'^. For 
this sequence, 

lim / v'{dJ') XwH'y^ia) XwH[y{a') = X^R{a,a') . (6.3) 

W->-Z'' J 

In particular, the variables {XwH{^{(7) : a G {— 1,+1}^) under the measure z/' converge 
in law to Gaussian variables (AZ(cr) : a G { — 1,+1}^ ) of covariance R{a,a') wherever this 
overlap is well-defined. This is encouraging, but one has to be cautious to obtain a complete 
proof since the overlaps R{a,a') are only defined F x F Kj{dr) almost surely, and since the 
convergence to the field I is not stronger than convergence in law. 

The proof goes along the lines of the proof of the continuity of the mapping that sends 
/i to the modified sampling measure (14. 3p . We refer to [1] for the details on some estimates. 
The idea is roughly to linearize the dependence of hj and F in the denominator of (16. 2p using 
the weak law of large numbers. An application of Fubini's theorem and the convergence (16.30 
concludes the argument. 

Consider n copies cr^, r = l,...,n, of s replicas each: cr = (a^, . . . , a**). Define 
Gw{cr,J',Xw) as 111=1 exp (Ai^if(y(cr')) and 

F a^n" r \ Aw^W - n ^"=1 F{(t'')Gw{(t', J', Xw) 

where F{(t) = F{R{a^,a^) : 1 <i < j < s). Using standard manipulations in the spirit of 
the weak law of large numbers it is not hard to show that there exists a C > that only 
depends on F (in particular not on W) such that 



'idJ')Kj[T^-'{Fw{{(T^}:^=„J\XwVW^\))] 

Tx^{F{(t)Gw{(t,J',Xw)) 



u'{dJ')Kj 



Fx^(G^y(^T,J',AH/)) 



< 



C 



(6.4) 



n 



A similar estimate holds for the ROSt with sampling measure /xj. Let E^ denote ex- 



pectation over a standard Gaussian variable and z = {z , . . . , z' 
Y[i=i exp(A/(f*) + Az*iyr^^^]|t7|p), and for n copies of {v, z), 

^E:=iF{vnG{v\z^,i,x) 



Write G{v,z,l,X) 



FMv\zTr=i,l,^) 



^E:=lG{vr,zr,l,X) 



where F{v) = F{v' ■ : I < i < J < s). Note that E^'G{v, z,l, X) = HLi exp(A/(t;*) + 



. In particular. 



E,E 



ifijxE,r^{Fiv)Giv,zJ,X)) 
{HjxE,Y^{G{v,z,l,X)) 



(6.5) 
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C (6-6) 

'n 



equals the right-hand side of (16.21) . The same manipulations as for (16. 4p yield 

' [ {fijxE,)x^{G{v,z,l,X)) 

The important feature of the estimate (16. 4p is that it holds uniformly in W. Therefore (16. 2p 
can be proved by a standard e-argument by picking n large enough once it is established 
that 

hm / i^'{dJ')^j[TX-^{F^{{cT^'}-^„ J', XwVm))] 

= EMiifij X E,r^'{FM'^^,^'^}:=iJ,X))] . 

Observe that the function F^r after integration over u' is one that depends on the R- 
overlaps of ns replicas (through F{(t)) as well as the i?^-overlaps, being the covariances of 
the field H{^. Accordingly, define the function F 

F({i?^(a",a'-'^)};{i?(a",a'-'^)},AH/vWl) := / iy'{dJ')Fw{{cTy,=,, J' AwVW*\) , 

(6.8) 

where r, r' range from 1 to n and i,j from 1 to s. It is understood that the first set of 
coordinates of F contain the dependence on the covariances of the field and the second 
set, the dependence on the i?-overlaps within F{cr). Moreover, since R{<J, a) = R^{<J, a) = 1 
for every a, the dependence of F is only on the overlaps of distinct replicas, i.e. for r ^ r' 
OT i ^ j. This will be important. It is easy to check that F is continuous in each overlap 
coordinate, thus bounded. Since Ymvy^^id R^ {a,a') = R{a,a') for F x F Kj{dr) almost all 
a and a' and Avka/|W^*| — ?■ A by definition, the dominated convergence theorem implies 



hm «:^[F><"^(F({i?^(a", a^'^)}; {R{a", a^'^}, XwVW^D] 
w^Z'i _ (6.9) 

= Kj[T'<"^{Fi{Ria",a^'^)};{Ria",a'-'^)},X)] • 

As it appears on the right-hand side, the function F is a continuous function on ns replicas 
in the sense of (12. Sp . since it depends only on the i?-overlaps of distinct replicas. By the 
definition of the ROSt in ([321), 

Kj[F^"''(F({i?(a'^\a"'^)};{i?(a'^\a'^'^)},A)] = E/i^"*(F({t;" . (6.10) 

It is readily checked that the expectation EiE^"'^[Fxd{{v'^ , z*"}"^!, /, A)] depends on {t>"-f '"'■''} 
through F{v) as well as through the covariances of the ns Gaussian variables 

that have variance 1 and covariance v" ■ v"^'^' for r ^ r' oi i ^ j . In fact, the dependence is 
exactly as for F. Successive applications of Fubini gives 

¥.^iY^(^{{v^\v^'^}■{v^\v^'^},X)=Eln^^JxE,Y'-^[^^^^ . (6.11) 

Equations (16. 8p — (16. lip imply (16. 7p . thereby concluding the proof of the theorem. 
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A Appendix 



We present for completeness a more standard approach to prove stochastic stabihty (see e.g. 
[TJ [T71 H]). A shght modification of the standard proof is needed since the ROSt in (13. 2p is 
defined as a hmit of the local overlaps i?'^, whereas the proof of [TJ [T71 H] works for ROSt's 
defined as in (I2.10p for the overlaps of the entire system. Precisely, in the proof that follows, 
the parameter f3 is varied infinitesimally within a window W keeping the parameter outside 
fixed, whereas in the standard proofs, it is varied throughout the system. The argument 
proves stochastic stability of the ROSt at any /5 for which the quenched free energy 



is differentiable. It is well-known that the infinite-volume limit exists whenever A — j- Z in 
the sense of Van Hove [23|, i.e., — > 0. 

Theorem A.l. Consider the EA model on Z"^ with Gaussian couplings with distribution v . 
Let 13 > be a point of differentiability of the free energy f of the system. Then the ROSt 
Qj constructed from a metastate kj as in (13. 2 p at temperature /3 is stochastically stable for 
u-almost all J. 

Proof. Let A C Z'^ be finite and W G A. The Hamiltonian H\^j{a) can be split into the 
Hamiltonian of the interactions strictly contained in W (denoted Hw,j), the Hamiltonian of 
the ones strictly contained in (denoted H/<^^w,j) and the interactions of the edges with 
one end point in W and one in (denoted Vdw,j{<^w,<^W''))- If <^w stands for the spin 
configuration in W and aw for the one in W^, the Hamiltonian becomes: 



The parameter /3 of the Gibbs measure will be fixed outside W and varied inside. The 
notation will only keep track of the dependence on /3 inside W. We write (3w for its value. 
The Gibbs measure will be denoted by Gx,i3yy,j- The variation of the parameter /3w will be 



Since the couplings J are assumed to have Gaussian distributions p, for any A > one has 
the following identity in law, where J and an independent copy J' are distributed under u: 




MX) := ^/P^ + \y\W* 



/3wiX)Hw,jicrw) 



law 



l3Hw,j{(Tw) + 



A 



Hence 




A 



(A.l) 
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Let F denote a continuous function on s replicas cr = (cr\ . . . , a"). There exists C > 
such that |-F| < C. We write for short 

Fw{(T)=F{R^{a\a^) : l<i<3<s) , 

F{(t) = F{R{a\ a^) : 1 < i < J < s) , 



and 



where v 



F{v) = F{v' -v^ : l<i<j<s), 
f*) are vectors in a Hilbert space with inner product Theorem 12.11 



and the dominated convergence theorem apphed to the i? -overlap give 

hm hm / uidJ) Gl',j{Fwi(T)) = [ u{dJ) «:j[rx^(F(^T))] . 

In this limit, and in subsequent ones like it, the volumes A are taken over a sequence used 
previously to construct the metastate, and W converges to in the sense of van Hove. By 
the definition of the ROSt Qj with sampling measure /i in fl3.2l) as well as Theorem 13.21 on 
the independence of the ROSt on the couplings, for i/-almost all J 



v{dJ) Kj[T-\F{<T))]=W. ^^^\F{v)) 



According to Definition 14. 2^ stochastic stability of Qj will hold if two limits are shown. First, 



lim lim / y{dJ)Gl' AFw{cr)) 



(A.2) 



for z/-a.e. J 



where / = (/(f) : w G i3) is a Gaussian field on B C Ti independent of /ij, with Eil{v)l{y') 
V ■ v', and Ei denotes the expectation over this field. And second. 



lim lim 



^idJ)Gi:pM>^)jFw{cT))- / u{dJ) Gi:^^j{Fw{cT)) 



. 



(A.3) 



Equation (1A.2P follows from identity (lA.ip and the same approximation scheme that proved 
06. 2p . We focus on showing (lA.3p . 

Straightforward differentiation yields 



dp^ J u{dJ) GZ^jFwH) 



s I u{dJ)g]^-^^^^j[[HwA^l^)-GA,p^,j{Hw{alv))]Fw{a) 
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Hence the absolute value of the derivative is bounded by 
By integration, we have the bound 

d^'w J ^(dJ) gA,i3{^.,j\Hw,j{(Tw) - QA,f3'^,j{Hw,j{(rw))\ ■ 



The integral term goes to zero in the limit. Indeed, by the Cauchy-Schwarz inequality, 



v{dJ) d[5'^ g^^p,^ \Hw{a) - g^^p.AHw{cy))\ < 

^\W\{Pw{X)-P) U HdJ) dP'^^^ g^^^-^,j\Hw{a)-gA,^'^,j{Hw{a))\ 

Since Pwi^) — P = 2i3\w*\ \W*\/\W\ is bounded in Z'^, the claim would follow 

if the term in the parentheses goes to zero as A — Z"' followed hj W Z'^. Define 

fA,wiM ■■= TT7n / ^(rfJ) log ^"^""^-^ 



IP^I / V 7 to g/3HA,W',j(fTwc) 

The second derivative fj(,w{(3w) is exactly the term appearing in the integral of the paren- 
theses. In particular, the integral in the parentheses equals 

We claim that 

lim limsup IfA^wiPwW) - fA,wil3)\ = 

Since /3vy(A) — )■ /3 as — > Z'^ and /3 is a point of differentiability of /, this will hold by a 
standard result of convexity (see, e.g., p. 94 in |i22j) provided that for all (3w > 

lim limsup/A,vy(/3H/) = ■ (A.4) 

This is expected since the free energy / is typically not sensitive to the boundary conditions 
imposed by A on W. We make this precise. Let 



fw{P,W):=j^ j v{dJ) logj^e'^ 

EQl^wHw,jio'w) fDl3HA,w,j{o'w'^ ) 



u{dJ) log 
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where the second equahty holds trivially for any choice of A D W and is a spin config- 
uration in A\W. Remark that because the couplings are Gaussians 



jy^(lj^^l3wVew,j{<^w ,o-w<^) — \dW\ 

where \dW\ denotes the number of edges with one endpoint in W and one in W^. Since the 
couplings in Vdw,j are independent of the ones in W and W^, Jensen's inequality applied to 
the logarithm in fA,w and through the integration over these couplings gives 

< IaMM - fw{M < • (A-5) 



Morover it is clear that 



f{(5w) = lim fw{M . (A.6) 



In view of ( lA.Sp and ( 1A.6I1 . 



lim sup \ fA,wi.M - fw{.(iw) \ = , 

and flA.4p follows. 

□ 



B Overlaps for pure states 

We first recall the definition of mr from Section Given F G Qj, the set of Gibbs measures 
for the EA Hamiltonian and coupling configuration J, mr is the unique Borel measure on 
M, the set of Borel measures on { — 1, +1}^ such that mr{ex{Qj)) = 1 and 

r = / pmr{dp) . 

J ex{gj) 

Again, we will drop the dependence on J in the notation Qj when it is obvious from the 
context. 

In this section we will prove that overlaps between pure states sampled from the measure 
mr for F in the support of are a.s. constant. Because the arguments are mostly from |20j . 
we will only give the main ideas. For notational convenience, we will prove the statement 
for spin overlaps, but essentially the same argument holds for edge overlaps. We will do this 
by showing that the variance of R with respect to the measure pi x p2 (for pure states pi 
and P2) is 0. We first list some properties of pure states and of the Choquet map F h-> mr. 
Let Too be the tail field of the space of spin configurations. 

Lemma B.l. Let p G ex{Q). 
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1. For each A G T^, 

p(A)G {0,1}. 



2. For each fixed x G Z*^, 



lim \p{a^ay) - p{o^)p{cyy) \ = . 

\y—x\^oo 



Proof. The first part of tlie lemma is proved in Tfieorem III. 2. 5 of [20] and the second part 
in Theorem III. 1.6. □ 

For the next lemma, consider the norm on the set of Gibbs measures that generates the 
strong topology: 

lirii = sup |r(/)| , 

ll/l|oo = l 

where the supremum is over continuous functions /. For a measure m on Q, define ||m|| 
similarly, but with continuous functions / on Q. 

Lemma B.2. Let T,T' G Q. 

1. IfT is absolutely continuous with respect to T' then ^ is Too-measurable, mr is abso- 
lutely continuous with respect to mp, and for each p G ex{Q), 

dmY 



drnj 

2. The following equation holds: 

||r — r'll = ||mr — mr>\\ . 

Proof. The first statement is [20l Theorem III. 5.1] and the second is [20l Theorem III. 5. 2]. □ 
Next, we notice that for pi and p2 in the support of (for F in the support of nj), 

Varp^^p^ I lim ^ V a^a'^ ) = lim V pi{a^ay)p2{a^ay) - pi{(y^)pi{ay)p2{a^)p2{(yy) 
\ ' ' zeA / ' ' x,j/eA 

' ' x',j/eA 

We would like to use part 2 of Lemma IB. II to deduce that this quantity is zero. For this 
purpose, we introduce the measure M* on the product space of triples (J, {cr*}j, {pi,p2)): 

M* = M X (mr x mr) . 

Sampling from M* amounts to sampling a pair (J, from M , noting the value of F, 

and then sampling two pure states independently from mr. We must check that this indeed 
defines a probability measure. For this it suffices to show the following: 
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Lemma B.3. For each Borel subset B of Q x Q , the map ( J, {(T*}j) t— )• (mp x mY){B) is 
measurable. 



Proof. Because the map (J, {cr*}i) h-)- F is measurable, it suffices to show that 

r ^ {rriY X mr){B) 



(B.2) 



is measurable. We show that the map (1B.2P is strongly continuous. It is elementary to show 
that each strongly open set in ^ is a Borel set in the weak topology, so this will prove the 
lemma. Let (r„) be a sequence in Q that converges strongly to F. Define 

7„ = (i/2)(r„, + r) . 

It is not difficult to see that the convergence r„, — )■ F is equivalent to the following: 

dTn dT 



d'Jn-^0 ■ 



(B.3) 



Using Lemma [B. 2 1 one can show that the quantity \{mr„ x mr„)(-B) — {mr x mr)(-B)| is no 
bigger than 



Pi 



+ / P2 



dTn 

djn 

dT 

din 



P2 



Pi 



dT. 



dT 



d'Jn d'Jn 

dT„ dT 



m^^{dp2)m^„{dpi) 



m^„(rfpi)m^„(o?p2) 



, d^n d^jq 

By the definition of the pure state decomposition and the fact that the above derivatives 
are constant a.s. in each pure state, this equals 



dT. 



dT 



djn d-fn 



din 



which converges to by ( IB.Sp . This proves that (]B.2[) is strongly continuous and completes 
the proof of Lemma IB. 31 

□ 

We will now show that for pi x p2-alniost all pairs {a^, cr^) (for M*-almost every (pi, P2)), 
( ]B.1|) equals zero. For a lattice vector a G Z'^, define the translation Ta on a triple in the 



support of M* by 

UJ,W%,ipi,P2)) = iUJ),{Taia%,iTaPl,TaP2)) , 

where for i = 1,2, the measure TaPi is defined as in Section [31 Since the measure M is 
translation-invariant and since the pure state decomposition of a state F is unique, the 
measure M* is translation-invariant. 
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The fact that (IB.ip equals zero for (mp x mr)-almost every pair (pi,p2) (for i^{dJ) x 
fi:j((ir)-almost all F) is a straightforward consequence of the following statement. With 
M*-probability one, if i = 1 or 2, then 



A^Z'i |A|^ ^ — ^ 



(B.4) 



To prove this, let e > 0. For each (J, {cr*}j,pj) and x G Z'^, we define 

Ni{x,e) = min{A^ : {piia^^ay) - pj(cr^)pi(o-j/)| < e for all y with |?/ - x| > A^} . 

By Lemma rB.lt Ni{x, e) < oo for each i, x and £. For fixed e, the distribution of the variables 
{Ni{x,e) : X G Z'*} under M* is translation- invariant. For a site x define the event Ax^^[N) 
that Ni{x,e) < N. Denoting by I[A^^^{N)] the indicator of the event ^^.^^(A^), we have that 
by translation-invariance. 



exists M*-a.s. Furthermore, for fixed e > 0, limAr_!.oo -^(iV, = 1 M*-a.s. 

Fix N such that with M*-probability greater than 1 — e, there exists a random set S of 
vertices with (well-defined) density greater than 1 — e such that for each x & S, we have 
Ni{x, e) < N. Then for a; G 5 n A, 

J2 Ipi^^^y) - P(^X)P(S)I < SAT'^ + ^|A| , 

yeA 



SO that 



limsup^ ^ |p(a^ay) -p(a^)p(cTy)| < limsup 



A^.Z<* 



x,y£A 



A-^Zd- 
< 3£ . 



|A| 



xeSnA 



2Ar'^ 



|A\5| 



Therefore with M* -probability at least 1 — e, when we replace the limit in flB.4p by limsup, 
it is bounded between and Se. Letting e — 0, we get flB.4p with M*-probability 1. 
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